Dynamical Entropy Production in Spiking Neuron Networks in the Balanced State 
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We demonstrate deterministic extensive chaos in the dynamics of large sparse networks of theta neurons in 
the balanced state. The analysis is based on numerically exact calculations of the full spectrum of Lyapunov 
exponents, the entropy production rate and the attractor dimension. Extensive chaos is found in inhibitory 
networks and becomes more intense when an excitatory population is included. We find a strikingly high rate 
of entropy production that would limit information representation in cortical spike patterns to the immediate 
stimulus response. 



Neurons in the cerebral cortex fire action potentials (spikes) 
in highly irregular, seemingly random sequences [IJ. Since 
neurons in isolation reliably respond to the repeated injection 
of identical temporally varying inputs f5l, the irregular activ- 
ity in the cortex is not believed to result from a randomness in 

the spike generating mechanism, but rather from strongly fluc- 
f — 1 

tuating synaptic inputs |3]. Several explanations for the origin 
of such fluctuating inputs have been proposed . The pre- 
vailing explanation is a dynamic balance between excitatory 
and inhibitory inputs, also known as the balanced state of cor- 
tical networks. Such a balance in neuronal circuits has been 
demonstrated experimentally in vitro and in vivo [6]. Its sta- 
tistical characteristics have been studied theoretically in net- 
works of excitatory and inhibitory neurons |5, 7] and in net- 
works of only inhibitory neurons, where the recurrent inhi- 
bition balances external excitatory currents |8]. These stud- 
ies established that in sparsely connected networks with rel- 
atively strong synapses the balanced state emerges robustly 
from the collective dynamics of the network, without an ex- 
ternal source of randomness. 

The dynamical nature of the balanced state, however, re- 
mains controversial and poorly understood. In a seminal 
paper, van Vreeswijk and Sompolinsky developed a power- 
ful mean field theory of the balanced state for excitatory- 
inhibitory networks of binary neurons Ist]. In their framework, 
nearby trajectories diverged faster than exponentially, demon- 
strating an extremely intense chaos with an infinite largest 
Lyapunov exponent. More recently, studies of inhibitory net- 
works of leaky integrate and fire neurons reported stable chaos 
JH]. Stable chaos, originally discovered in coupled map lat- 
tices is characterized by irregular but non-chaotic dynamics 
with a negative definite Lyapunov spectrum |9]. 

Answering the question of whether the balanced state is 
chaotic is of fundamental importance for understanding in- 
formation representation and processing in the cortex. If cor- 
tical networks were to generate stable complex firing patterns, 
these might serve as a coding space for storage and process- 
ing of, e.g., sensory information. If, alternatively, cortical 
networks operate in a chaotic regime, information process- 
ing would be intrinsically limited by the dynamical entropy 
production that turns microscopic perturbations such as ion 
channel noise into global firing patterns. 



In this Letter, we present a comprehensive characterization 
of the balanced state in networks of N canonical type I neu- 
ronal oscillators, called theta neurons ifioll . The theta neuron 
model explicitly describes dynamic action potential genera- 
tion and is equivalent to the normal form of a saddle node 
bifurcation on an invariant circle Ol ill . In contrast to previ- 
ously considered network models that exhibit phase spaces of 
varying dimensionality 1, 12,1 , the phase space of our network 
model is a fixed A^-torus. For these networks, we performed 
numerically exact calculations of the full spectrum of Lya- 
punov exponents, the rate of dynamical entropy production 
and the attractor dimension, and analyzed the statistics of the 
first Lyapunov vector We found that both inhibitory networks 
and excitatory-inhibitory networks exhibit deterministic ex- 
tensive chaos. The rate of dynamical entropy production in 
these networks was relatively high compared to experimen- 
tally measured information content of spike patterns in sen- 
sory cortices. 

We studied large sparse networks of N theta neurons ar- 
ranged on directed Erdos-Renyi random graphs of fixed mean 
indegree K. The theta neuron model is a phase representation 
of the quadratic integrate and fire model [11]. Neurons are de- 
scribed by phases 9i e [— tt, tt], with spikes defined to occur 
when 9i crosses tt. The governing equation is 
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All neurons i = 1 . . . N receive constant external excitatory 
currents \/KIf^^. These were identical for all neurons in the 
excitatory (E) and inhibitory (I) population, respectively, and 
chosen to obtain a target average firing rate ve = vi = v. 
At spike events of a presynaptic neuron j e pre (i), neuron 
i received non-delayed (5-pulses of strength Jij/\/K, lead- 
ing to step-like changes in the neuron's state. In inhibitory 
networks, every neuron was coupled to on average K presy- 
naptic neurons with J// = — Jq. In excitatory-inhibitory net- 
works, the inhibitory neurons received inputs from on aver- 
age K inhibitory neurons with J// = — \/l — £^Ja and K 
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excitatory neurons with Jie = sJq. The excitatory neu- 
rons received inputs from on average K excitatory neurons 
with Jee — 0.9eJo and K inhibitory neurons with Jei = 
— — (0.9e)^Jo. At e = 0, all excitatory neurons are pas- 
sive, since they only receive inputs from the inhibitory neu- 
rons without providing feedback. Increasing e activates the 
excitatory feedback loops, such that the magnitudes of input 
fluctuations — J^v a re preserved and identical to those in 
inhibitory networks [131] . 

From the analytical solutions of Eq. ([TJ with ^ we ob- 
tained an N-dimensional map of the neurons' phases between 
successive spike times in the network {ts} 11311 . This map 
was used for event-based, numerically exact simulations of 
the network dynamics and yields the single spike Jacobian 




di' {ts) for i = j = i* 

for^ = ^^J-J* (3) 
otherwise, 



where j* denotes the spiking neuron at time ts,i* e post (j*) 
the spike receiving neurons, Sij is the Kronecker symbol and 



di* (ts 



{tan{0,,{ts)/2)y 



(tan(0,. (f,-)/2) + J,,j,/VKf + ^/KIp' 



(4) 

where 6i* {tj ) denotes the phase directly before spike recep- 
tion ifn . 

The exact Jacobians (|3]l were used to numerically calcu- 
late all Lyapunov exponents in the standard Gram-Schmidt 
reorthogonalization procedure ifisi From the Lyapunov 
exponents Ai > ... > A at, we derived the Kolmogorov- 
Sinai entropy production (Pesin identity): H — X^a >o 
and the attractor dimension (Kaplan- Yorke conjecture): D ~ 
d + Sd/\Xd+i\ (with d the largest integer such that Sd = 
Ef=i Ai > 0) fH. AU calculations were repeated with 10 
different initial conditions and network realizations. In all 
Figures below, standard errors are smaller than the symbol 
sizes. 

The characteristics of inhibitory networks and excitatory- 
inhibitory networks in the balanced state are depicted in 
Fig. [U Representative spike patterns and voltage traces 
V{t) = ta.n{9{t)/2) illustrate the irregular, asynchronous fir- 
ing and strong membrane potential fluctuations. In agreement 
with recent biolo gica l observations, the firing rate distribu- 
tions were broad 11611 . indicating a substantial heterogeneity 
in the networks. Distributions of firing rates and coefficients 
of variation were identical in both types of networks. 

We first characterized the dynamics of inhibitory networks 
in the balanced state (Fig. |2]i. These networks exhibited de- 
terministic extensive chaos, characterized by finite positive 
maximal Lyapunov exponents and network size invariant Lya- 
punov spectra [13]. As a result, the attractor dimension and 
entropy production increased linearly with the number of neu- 
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Figure 1: (color online) Characteristics of the balanced state in in- 
hibitory and excitatory-inhibitory networks of theta neurons: (a,c) 
Spike patterns of 40 random neurons, (b,d) Voltage traces of one 
random neuron, (e) Firing rate distributions, (f) Coefficient of vari- 
ation distributions and (g) Stationary voltage distributions, (param- 
eters: iV = 10000, K = 100, = 1 Hz, Jo = 1, = 10 ms, 
r = 0.9, e = 0.3, Ne = 4Ni) 



rons in the networks. The range of the Lyapunov spectra in- 
creased with the average firing rate, such that the maximal 
Lyapunov exponent, entropy production and attractor dimen- 
sion grew for larger firing rates. The chaotic attractors had a 
large dimensionality of the order of the phase space dimension 
N. The average entropy production (information loss) was of 
0(1) bit per spike per neuron. We remark that this is surpris- 
ingly high compared to the estimated information content of 
0(1) bit per spike in primary sensory cortices llTlllSll . 

Adding an excitatory population to the networks increased 
the intensity of balanced state chaos (Fig. [3]l, while the mag- 
nitude of input fluctuations and the basic firing statistics were 
preserved. When the excitatory neurons are passive (e = 0), 
their dynamics is fully controlled by the inhibitory neurons. 
The positive part of the Lyapunov spectrum was then equiv- 
alent to that of an isolated inhibitory network of reduced 
size N ^ Ni (dashed line). Hence, the maximal Lyapunov 
exponent was identical, whereas the entropy production per 
spike per neuron and the attractor dimension density were re- 
duced accordingly by one fifth. Upon activation of the exci- 
tatory feedback loops (e > 0) the entire Lyapunov spectrum 
changed. The maximal Lyapunov exponent, attractor dimen- 
sion and entropy production increased with e, demonstrating 
an intensification of the chaos. 



Are all neurons involved equally and at all times in 
the chaotic dynamics despite their substantial firing hetero- 
geneities? To answer this question, we studied the first Lya- 
punov vector 5(j){t) iJ2iLi^'t'i{t)^ — 1)- At each point in 
time, sip aligns with the direction in which initial perturba- 
tions exponentially grow with maximal asymptotic rate A^ax. 
The Lyapunov vector was dominated by relatively small sub- 
sets of neurons that changed over time (Fig. H]). We ana- 
lyzed the composition of these groups with two quantities: 
the participation ratio P{t) = 1/ X]t=i quantify- 
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Figure 2: (color online) Extensive deterministic chaos in balanced inhibitory networks: (a) Full Lyapunov spectra for different average firing 
rates T/, collapsed for different network sizes, (b) Maximal Lyapunov exponent, (c) Mean Lyapunov exponent, (d) Entropy production rate H 
and attractor dimension D for various network sizes TV, (e) Average entropy production per spike per neuron, (f) Attractor dimension density 
(parameters: N = 2000, K = 100, i> = 1 Hz, Jo = 1, r,,, = 10 ms) 
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Figure 3: (color online) Chaotic dynamics in balanced excitatory- 
inhibitory networks at different excitatory feedback loop activations 
e: (a) Lyapunov spectra, (b) Maximal Lyapunov exponent, (c) En- 
tropy production per spike per neuron, (d) Attractor dimension den- 
sity (dashed lines: isolated inhibitory networks with A'^ = Ni, pa- 
rameters: iVi = 2000, Ne = 8000, K = 100, v = lUz, Jo ^ 1, 
Tni = 10 ms) 
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Figure 4: Temporal network chaos in balanced inhibitory networks: 

(a) First Lyapunov vector (50 (t) (marked black if j(5(;/>i(^)l > 1/\/TV), 

(b) Participation ratio P(t) of first Lyapunov vector, (c) Voltage dis- 
tribution of neurons with largest Lyapunov vector elements (dotted 
line: stationary distribution) (d,e) Neurons' chaos indices Ci versus 
firing rates Ui and coefficients of variation cvi (straight line: mean, 
dashed lines: ±2 std), (f) Average participation ratio P vs. network 
size N (dotted line: guide to the eye for P ~ A*'), (parameters: 
TV = 2000, K = 100, u^lHz, Jo = 1, Tn, = 10 ms) 



ing the size of a group at time t 01911 . and the chaos index 
Ci — N {54)i{t)'^)t quantifying the time-averaged partici- 
pation of individual neurons. The participation ratio exhib- 
ited substantial fluctuations indicating strongly varying group 
sizes. For the considered rates IHz < P < 10 Hz, the time- 
averaged participation ratio P = (P(t))t obeyed a sublinear 
scaling P - TV", with 0.25 < a < 0.5 til. Thus, although 
the average group size grew with network size, the fraction of 
most unstable neurons decreased algebraically as TV"~^. The 
chaos indices were essentially independent of the neurons' fir- 
ing rates and cv values. This means that statistical firing irreg- 
ularity is unrelated to chaoticity. Thus, although at any time 
only a small group of neurons constitutes the most unstable 
direction, over time all neurons participated almost equally in 
the chaotic dynamics. 

To understand when the neurons were the most sensitive 
to state perturbations, we examined the voltage distribution of 
neurons when exhibiting the largest Lyapunov vector element. 
This distribution compared to the stationary distribution was 
shifted towards the spike generating instability, marking it as 
an important source of instability of the collective dynamics 
(Fig. He)). 

The chaotic dynamics of balanced networks described 
here shares many features with classical examples of spatio- 
temporal chaos 1 19]. Balanced networks exhibit a size- 
invariant Lyapunov spectrum and extensive entropy produc- 
tion rate and attractor dimension. The chaotic degrees of free- 
dom are confined to small and varying groups of elements. 
The type of this localization, however, differs from classical 
examples of spatio-temporal chaos. While classically, the par- 
ticipation ratio is constant for large TV, we here found an al- 
gebraic sublinear dependence. This behavior apparently re- 
flects the non-local graph structure of the systems and might 
thus be termed temporal network chaos. In fact, chaos in bal- 
anced networks is induced by the complex network connectiv- 
ity: neither the isolated units nor a fully connected network of 
theta neurons exhibit chaotic dynamics. Extensive chaos is ex- 
pected in spatially extended systems, that can be decomposed 
into weakly interacting subsystems, whose number grows lin- 
early with system size |20]. As this is not fulfilled for network 
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dynamical systems on random graphs, extensive chaos in our 
networks is not a trivial property. Globally coupled networks 
for instance can in fact exhibit non-extensive chaos 112 ill . The 
extensivity found for balanced chaos likely reflects the lack of 
correlation between neurons in this state. Even in densely con- 
nected random networks, pairwise correlations are expected 
to vanish in the large system limit i22ll . Then, the invari- 
ant measure will factorize and the attractor becomes 0{N)- 
dimensional in the large system limit. It should be noted that 
the studied networks may be viewed as subunits of cortical 
networks that can be approximated with random connectivity. 
In spatially extended networks, composed of such subunits, 
extensivity may be expected for standard reasons. 

Our results reveal that the dynamics of balanced networks 
strongly depends on the single neuron dynamics. While we 
found that theta neurons in the balanced state exhibit conven- 
tional extensive chaos, previous studies of networks of leaky 
integrate and fire neurons demonstrated stable chaos Jsl] . Op- 
posed to the leaky integrate and fire model, the theta neuron 
model incorporates the dynamic instability underlying spike 
initiation. The membrane potential distribution of the neurons 
when most sensitive to perturbations is indeed shifted towards 
this instability. Our results thus indicate, that this feature of 
single neuron dynamics renders the collective dynamics of 
balanced networks robustly chaotic. 

The strikingly large entropy production we found raises 
questions about the neural code in cortical networks. If the en- 
tropy production is of the same order of magnitude as sensory 
information carried by spikes, sensory information would be 
hard to maintain in spike patterns beyond the immediate stim- 
ulus response. In fact, a study of spike timing in barrel cortex 
showed that information about whisker deflections is encoded 
to 83% in the first spike after the stimulus and reduced in each 
successive spike by roughly two thirds flS*]. Since the theta 
neuron model is the canonical form of type I excitability, our 
results are expected to be representative of a wide range of 
single neuron dynamics. The reliable generation of long and 
precisely timed spike sequences by cortical networks would 
then be unlikely. 

The fat chaotic attractors in balanced networks described 
here might serve as a rich repertoire of complex states the net- 
work is rapidly plowing through. Our study lays the foun- 
dation for future research on dynamic stabilization mecha- 
nisms for unstable states or reliable computations on short 
time scales on existing stable directions. 
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Note added in proof: Our findings of a strongly chaotic dy- 
namics is consistent with novel experimental evidence of a 
high sensitivity to perturbations in cortical networks in vivo 

m. 
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